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1. Abstract 

Tactile perception of shape involves an on-line controller and a shape perceptor. 

The purpose of the on-line controller is to maintain gliding or rolling contact with the 
surface, and collect information, or track specific features of the surface such as 
edges of a certain sharpness. The shape perceptor uses the Information to perceive, 
estimate the parameters of, or recognize the shape. The differential surface model 
depends on the 'nformation collected and on the a-priori information known about the 
robot and its physical parameters. These differential models are certain functionals 
that are projections of the dynamics of the rnhot onto the surface gradient or onto the 
tangent plane. They involve t.hp states of the rohot (l.e., angles and angular veloci- 
ties), input torques or forces to the robot, the coefficient of friction u, and some of 
the differential properties of the surface such as the units of tangent and normal to 
the surface, gradient, Hessian, and the radius of curvature and its projections onto 
planes. A number of these differential properties may, be directly measured from present 
day tactile sensors. Others may have to he indirectly computed from measurements. 

Others may constitute design objectives for distributed tactile sensors of the future. 

A parameterization of the surface leads to linear and nonlinear sequential parameter 
estimation techniques for identification of the surface. Many interesting oomprnmises 
between measurement, and computation are possihle. 

?. Introduction 

Tactile perception of shape" by natural systems has heen the subject of many recent Judies HI. 
perception in rohotic systems requires maintenance of gliding and/or rolling contact with the unknown ohqect and 
infering information about the' shape. A major component of this kind of probing is the controller The ^con- 

troller needs on-line construction of the kinematics fZl, force feedback HI, and inverse dynamics f41 to gener- 
ate tbo needed input torques to the robot joints. The available tactile sensors to date, howevpr, are not a 
quate for fast and efficient' execution of rollinq and gliding manipulations lb, fit. dnce gliding nr ro ,1n n 
maintained, the percept! nn ; of shapes involves using kinematic, and dynamic information to gather nformation 
about the manipulated object 1*71. The process of determining the shape involves availability of a-priori compu- 
tational and symbolic models of shape fB], 

For smooth surfaces, that are linear in an unknown parameter vector, linear sequential estimation algor- 
ithms can be used to arrive at these parameters ("9, 10,11}. Alternatively, solution of partial differential 
equations or nonlinear estimation algorithms are needed TlO]. 

Vihen the nhject or surface is known, the trajectory of the robot end effector can be a-prinri determined 
the control of hoth gliding fl2,13l and rolling T141 on known surfaces has been studied before. -own 11SI has 
considered rhe control problem for gliding on unknown objects. This paper deals with the kinemat.es and dynam- 
ics of gliding and rolling contact of a known end effector gliding and/or rolling on an unknown surface Two 
differential surface models for perception are derived. For parametric surfaces a linear sequential estimation 
algorithm is sketched. 

3. The Kinematic Problem 

The on-line kinematic problem for purposes of qlidinq and rolling on an unknown surface is discussed here 
by a single two rigid body problem. A planar rigid hndy end effector is considered that maintains contact with 
an unknown rigid body by gliding or rolling on it (Fig. 1). The internal coordinate system of the end effector 

is the y iyn axes centered at the center of qravity of the end effector A and parallel with the principal axes of 
the end effector. The smooth surface of the end effector is assumed to he known implicitly or parametrically m 
its own coordinate system. 

C(Y) = n 

Y * Y(„) » y2(«)f 

and the point of contact B (in gliding) is specified hy ,-y 
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Yr - Y(ai) (2) 

Similarly the smooth unknown surface may he characterized parameterlcally or Impllclty. An implicit representa- 
tion is assumed here: 

n(X ) - h(* ltX 2 ) - 0 (3) 

Let the coordinates of A be given hy the two-vector X*. The coordinates of the contact point R In the inertial 
coordinate system are 

|” COSO 3 -s1no3 1 

Xr « X A ♦ | | Yr (4) 

!_ slnC '3 cosO 3 J 

The control requirements for gliding contact are: 

1 . existence of the normal contact force’ to maklnq sure that the contact Is maintained, 

2 . knowledge about itfcf oolnt of contact, 1 

3. guiding the motion of the end effector, along the unknown surface, 
and finally, 4. knowledge of the radius of curvature of the unknown surface. 

along the unknown surface. A control Input to this guidance is the tangential velocity of contact \a*(t). The 
latter guidance requires sensing of the unit tangent vector T at ft In the end effector coordinate system and 
transforming It to the Inertial coordinate system 

X R (t > • v(t)T (A) 

Differentiating Eq. ( 4 ) with respect to time and substituting in Eq. ( 5 ) gives 

|~ s1n03 cos: 3 "| 

X A (t) » v(t)T + :- 3 | | Y r (61 

l_ -co**3 + s 1 hv 3 J 

Eq. (6) relates the local translational velocities X A to the angular velocity of the end effector '.3. 

Another interpretation of Eg. (6) Is that the terms on the right side of Eq. (A) are respectively a small 
translation of point A and a small rotation of point A ahout point R. The angular velocity r -$ itself is a func- 
tion of the local curvature of the unknown surface at the point of contact. Let ds he tho traversed distance n« 
the unknown surface. Ay definition, the radius of curvature is given hy 


d; 3/ds d: 3 - .' 

. d: 3 Ids v(t ) 

; 3 * * * ifi) 

d t dt r,, 

Therefore, Eqs (A) and (8) together define the instantaneous kinematics of the qlldinq motion. 

In the rolling motion the contact point moves on the end effpctnr as wpII as on tho unknown surface so that 
the incremental distances traversed nn noth surfaces aro equal . In addition to the four r-pqu 1 rpnonts of qliaino 
motion as before, the end effector should have knowledge of Its own local radius of curvature at the point nf 
contact. Assume v(t) 3 ds/dt is the specified control Input, and assume a convex surface, ana a cn^vo* end 
effector surface as in Fig. 1 . It is not difficult to show that 

1 1 

. 3 - v(t ) — + — ’ (R) 

r, e -u 

where p e and - u are respectively the local radii of curvature of the end effector and the unknown surface at the 
point of contact. 

Similarly from the incremental form of Eq. ( 4 ) and the definition of rolling, it follows that 


! +sin03 C0SG3 | 

dX A = ! ! do 3 Yr (in) 

t_ -cos.t3 sine. 3 ! 


. . | sin03 COSO3 I 

or X A * 03 j | y r 

|_ -COSO3 sinc.3 _l 


To summarize, Egs (8) and (II) are the instantaneous kinematics of the rolling motion. 
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If the unknown surface Is convex, Eq. (9) Is replaced by 


03 « v(t) ( — ) 

Pe Pu 

Suppose the center of gravity of the end effector Is connected to a two link robot (Fig. 2). 

Xa . |" 1 ' C0S ' il * ,2C05 ° 2 ] (13) 

|_ iislnei + l2 s1n6 2 _! 

Differentiating Eq. (13) with respect to time gives 

|_ ticosQi ♦ *2C0S9 2 J l_ 02 J 

The latter equation provides the Instantaneous kinematic of the three-link system. 

0 * [0i 02 03 ]* 

for either of the gliding or rolling motion. 

From the above discussion It can he stated that measuring or estimating the local radius of curvature Pu of 
the unknown object and determining convexity or concavity are two Important parameters for the kinematics o 
rolling or gliding. The local radius of curvature has two more uses. 1) It is needed for an deal inverse 
dynamics systems where the accelerations are needed to construct the Input torques [111. It Is needed for 
detecting snarp edges (small p u ) and consequent tracking of such sharp edges on three dimensional surfaces. 

4. The Dynamics Problem for Point Contact 

Consider the three-link planar robot of Fig. 2 with no contact with any object or surface, the equations of 
motion for this system [12,13] are 

0(0)0 + R(0)0 2 + E(0 ) - cil Hfil 

where U Is the vector of torque actuators at the joints. Suppose the gliding is on a frictionless surface. The 
contact force is along the unit normal vector N to the surface, and assume its magnitude is v. The Incremental 
motion of the contact point on the robot Is 

|’"-sin0 3 -COSO3 I 
dX R = dX A + I I Yr <10 3 

COSO3 -s1n03 J 

Let N be resolved In the Inertial coordinate system. The incremental work of the contact force is 


where < > is the inner product, and 


dll 1 < yN, dX R > 


dVl dX R 

— * < v N, > 

d' dO 


-ijsinOi 

-l2 s1niJ 2 


ZlCOSOi 

*2COsC-2 


|_-y 1R s 1 n <)3 - Y 2 RCOS 03 + yiRCOS 03 - y2RSin(>3 J 


The equation of motion with the contact In effect are: 


J { 0 )0 + R(0)0 2 ♦ E(o) = CIJ + 


The holonomic constraint governing the dynamics Is 
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o(x R ) - o 


(18) 


Differentiating Eq. (18) with respect to time gives 


. dX R * dD dot dX R 

9* • 9 ■ 0 (19) 

do dX dX do 

A final relation that Is Important for the analysis to follow Is the definition of the unit normal vector 
N. The gradient vector of the unknown surface Is dO/dX and by definition 


dD 

dD 


N « — 

/ 1 — 1 

(20) 

dX 

dX 



where i i Is the Euclidean norm. 

Consider the rolling type of constrained motion. Let the magnitude of the tangential constraint force be X. 
The contribution of these forces to the equations of motions Is 


dW dX R 

< , (Ny + TO > (21) 

dQ dO 


For the rolling motion, there are two constraints. The holonnmlc contact constraint of Eq. (18) and the non- 
holonomle roll constraint — no motion along T at the point of contact. 

dX,} dX R . 

Tt — » T* e-0 (22) 

dt de 

Eq. (19) implies no motion of the contact point along the unit normal wctor. Eq. (22) means no motion of the 
contact point along the unit tangent vector. Consequently the only possible motion Is a rotation ahout the con- 
tact point and hence a rolling motion. 

In order for rolling to occur and no slippage or gliding to take place, the coefficient of friction ^ must 
be different than zero and the forces of constraint mist be governed by 

0 < x < ny ( 23 ) 


5. Differential Surface Models 


In this section constituent relations between the state G, 0, the Input U, the forces and the surface 
geometry are derived. If the surface Is known, these equations can he used to solve for the forces of con- 
straint y and IT alternatively, the forces are known, these equations can he used as differential surface 
models, and used for estimating the shape of the surface. These constituent relations are arri ved at hy differ- 
entiating the constraint Eqs. (18) and (22) with respect to time and eliminating the acceleration b between the 
latter second derivatives and the equations of motion. 

The above procedure could be carried out simultaneously for hoth constraints. However, it Is done for the 
individual constraints here in order to demonstrate two alternative formulations, one more analytical, one 
slightly more suitahle for computational purposes. 


5.1 First Formulation . The differentiation of Eg. (1R) with respect to time qlves: 

. dX R * on 

9* — - 0 

d0 dX 

This equation implies no velocity component exists along the unit normal. An alternative form for Eq. (24) 

X R t(t)N = 0 


(24) 

i s 

(25) 


The differentiation of Eq. (24) with respect to time gives 

dX R t dD . dX R f d 2 0 dX R . .0 

Qt 4. gT g + gX 

do dX de do 30 

Elimination of o between Eqs. (26) and the dynamics of the system 


I dO" 1 dX R i . 

| ! 9 . - 0 

|_ dX do | 


(26) 


JO 


+ R(0)0 2 + E(o) 


dX R 

Cl! + < , Ny + T\ > 

d0 


(27) 
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gives the first form of the constituent equation 

* d2 ° dX « ; ^ j 0 . fl ~ J-l | -R0 2 - E0 + Ctl ♦ — (Ny + T X) ! C 2 R> 

de qx 2 do as !_ dx do J »ix de i_ d0 J 

If all parameters and quantities In Eq. (28) are available. It Is a constituent relation In the unknown 
gradient and Hessian dd/dX and d 2 n/dX 2 . If N and T are also not available. It Is easy to Include Eq. (?0) for N 
and tbe following for T _ 

T - | |N W) 

l_ 1 0 J 

The result Is a more conplex constituent relation. Recause Eq. (28) Involves the first and second partial 
derivatives of the surface. It is a differential model of the unknown surface. If X. and Y are negligibly small, 
and/or If 0 —the angular wlocltles --are relatively small, Eq. ( 28 ) simplifies. 

5.2 Second Formulation. Eq. (28) establishes one relation among Y and X. A second relation among^x could 

be obtained 'in a similar fashion from the second constraint equation. However, an alternative formulation Is 

gl ven here. 


If Eq. (22) Is differentiated with respect to time, one obtains 

<1Xr •> . fl fIXq . 

Q + 0-t — ( T* -7 — • ) Q - 0 

do dO do 

Between Eqs. (27) and (30) one can eliminate 0 to obtain the second differential surface model 

J,t — — ( T s — — + Tt — J-l (Ro 2 + E } - T* — J-l | Ctl + («r + ^ I (311 

do do do do !_ d 0 J 

The above two differential surface models, are two independent Eqs. in Y and x. If ^« th fu2<-t?ins If 

known including the unknown surface, these equations can be solved for these constraint jrces as 
the state [Ot, o' 5 ]* , Input l! and the surface n(X) * fl. They provide differential Information about the surface, 
if everything else including Y and x Is known. 

6. Shape Perception by Parameter Estimation 

Suppose the unknown surface is representable hy a vector of unknown parameters 0. 

0 ( X ) * P*(X)0 - 1 {321 

one may use coordinates of the many contact point X R to arrive at a system of linear equations “"Jer the 

above assumption, the gradient and -the Hessian are also linear In 0. As a result the constituent dl^^ent 
surface models, sampled at some interval T of time provide Independent information about vector 0. These sys- 
tems of over specified linear equations can be solved for 3 . Let the overspecified system be 

M3 * N < 331 

where each row of the equation is one additional piece of information from sampling the constituent surface 
models or Eq. (32), etc. (an example is worked out in CIO]). The best estimate for 3 Is the mean square error 

sense [9] is 

0 * (MtM)’lw*N 

This equation is also robust with respect to a certain amount of independent random measurement noise. 
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Fiaure l- The planar two-body contact problem. Figure 2: Gross motion of the end effector center of gravity 

’ Sy a two-1 ink robot. 
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